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(57) Abstract 

A set top box is provided that interfaces a television and a personal computer that is connected to the Internet. The set top box 
includes a wireless remote control receiver that receives user commands from a wireless remote control unit. A radio frequency transceiver 
that transmits computer commands to the personal computer that is connected to the Internet in response to the user commands and that 
receives data that is generated from the Internet via the personal computer in response to the computer commands. A video processing 
system that processes the received data for display on a television and a television interface that displays the processed received data on 
the television. 
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Methods and Systems for Providing Television Related Services Via a 
Networked Personal Computer 



Field of the Invention 

The present invention relates to the field of 
television and more particularly to set top boxes for 
5 televisions. 

Background of the Invention 



The television (TV) has become ubiquitous in modern 
society. As a result, a variety of services are being 

10 provided via TV. Many of the services are provided using 
a set top box that works in conjunction with the TV to 
provide the desired service. One example of a service 
provided via a TV is an online TV program guide , wherein 
TV program schedule information is displayed on a TV for 

15 searching and selection by a viewer. Online TV program 
guides are described in U.S. Patent 4, 751, 578 to Reiter 
et. al. Entitled " System for Electronically Controllable 
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Viewing on a Television Updateable Television Programming 
Information" . Other popular services are also provided 
using a set top box. For example cable or satellite TV 
may be provided using a tuner packaged as a set top box. 
5 The tuner decodes the transmission from the service 

provider and formats the signal for display on the TV. 

Personal computers (PCs) have also been widely 
accepted into consumer's homes for a wide range of uses. 
A popular use is access to the Internet, and the World 

10 Wide Web (the Web) . The Web is an arrangement of uniform 
resource locators (URLs) on the Internet that, taken 
together, may provide a communications infrastructure for 
making services and products available to PC users. 

Some of the services available over the Internet are 

15 provided using set top boxes. One example of such a 

service is WebTV. WebTV enables a user to browse the Web 
using a TV as the display. WebTV r however, duplicates 
much of the hardware and software included in a standard 
PC. For example, WebTV includes a modem while many PCs 

20 come equipped with one. Consequently, the consumer who 
already owns a PC may pay the cost of the modem twice: 
once when buying the PC and a second time when buying 
WebTV. Furthermore, WebTV may also duplicate a portion 
of the functions found in most TVs. This duplication of 

25 PC and TV components may make WebTV unnecessarily 

expensive or complex to the many consumers who already 
own a PC . 

Information on the Internet may appear distorted 
when viewed on a TV. Information stored on the Internet 
30 may be formatted according to the aspect ratio of a 

computer display. A TV display, however, may not have 
the same aspect ratio as a computer display. 



WO 99/35831 



- 3 - 



PCT/US99/00461 



Consequently, information from the Internet may appear 
distorted when viewed on a TV. 

Summary of the Invention 

5 

The present invention provides systems and methods 
which use a PC to access desired information while 
watching television. The information may be stored 
locally to the PC or on a network (e.g, the Internet). 

10 Lower cost may be achieved by utilizing a PC to access 
the information, thereby eliminating the duplication of 
hardware in the set top box. 

'A Set top box according to the present invention 
includes a remote control receiver that receives user 

15 commands from a wireless remote control unit. A radio 

frequency transceiver that transmits computer commands to 
the personal computer that may be connected to the 
Internet in response to the user commands and that 
receives data that is retrieved by the PC in response to 

20 the computer commands. A video processing system that 
processes the received data for display on a television 
and a television interface that displays the processed 
received data on the television. 

Systems utilizing the present invention may be 

25 inexpensive compared to existing systems that duplicate 
hardware and software components found in many PCs and 
TVs. The present invention may use an existing PC to 
avoid replication thereby allowing a reduction in the 
cost of the system. Moreover, the PC may be connected to 

30 the internet, avoiding further duplication and enabling 
access to networked resources. For example, the present 
invention may be utilized to access to the Internet so as 
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to obtain information relevant to a specific television 
program currently being viewed or information independent 
of any particular program such as access to a chat-room. 
Additionally, the television may be interfaced to 
5 the PC and the Internet by wirelessly receiving user 
commands at a set top box and then wirelessly relaying 
computer commands that represent the user commands from 
the set top box to a personal computer in response to the 
wirelessly received user commands. The computer commands 
10 cause the personal computer to access the Internet in 

response to the computer commands and receive data from 
the Internet at the personal computer. The information 
is then wirelessly relayed from the personal computer to 
the set top box where the information is. formatted for 
15 display on a television that is connected to the set top 
box. The wireless connection may therefore avoid a 
physical connection between the PC and the television. 
Furthermore, the wireless connection may allow the 
existing PC and the television to be located in separate 
20 areas of the user's home. For example, the wireless 
connection may allow the PC and the televsion to be 
located in different rooms or on different floors of the 
user's home. 

The present invention may also be utilized to 
25 provide information likely to be desired while the viewer 
watches television. For example, the viewer may desire a 
listing of television programs and corresponding 
broadcast times, sports or weather information. 

The present invention may also display information 
30 from the Internet along with television images on a 

television display. For example, the user may select a 
mode wherein a portion of the TV display is allocated to 
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10 



displaying TV images while another portion may be used 
for interactive services (e.g., E-mail or chat-room 
participation) . The information from the Internet 
accessed by the user may be formatted in accord with the 
aspect ratio of the TV display so as to avoid the 
negative visual artifacts associated with the display of 
Internet information on a TV display. 

Accordingly, an existing PC may be used in 
conjunction with the set top box to supply many of the 
functions that may be desired by a user while watching 
TV. Moreover, the set top box may use the PC in 
conjunction with the Internet to supply the desired 
functions rather than .duplicating the functionality of 
the PC within the set top box. The user may access the 
15 information from a specific location on the Internet 
which is associated with the desired functions. For 
example, the user may desire program listings, sports 
scores, weather information, access to e-mail, or 
participation in a chat room that may concern a TV 
20 program presently being viewed by multiple users. By 

avoiding duplication of the PC functionality within the 
set top box, the present invention may provide a lower 
cost alternative to users who desire the above functions 
and already have a PC. 

25 

Brief Description of the Drawings 
Figure 1A is a block diagram of a system utilizing 
the present invention; 

Figure IB is an illustration of a wireless remote 
30 control of Figure 1A; 
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Figure 1C is an illustration of a TV display 
corresponding to a particular user command; 

Figure 2 is a block diagram of an embodiment of the 
present invention; 
5 Figure 3 is a flow chart illustrating an embodiment 

of the present invention; 

Figures 4A, 4C r 4D, and 4E are flow charts 
illustrating a command protocol that may be utilized by 
the present invention; 
10 Figure 4B is a block diagram of a packet format 

utilized by the present invention; 

Figure 5 is a table of exemplary instructions and 
commands used in an embodiment .of the present invention; 
and 

15 Figures 6 through 32 are examples of displays that 

may be used in a system utilizing the present invention. 



Detailed Description of the Invention 

The present invention will now be described more 
20 fully hereinafter with reference to the accompanying 
drawings, in which a preferred embodiment of the 
invention is show. This invention may, however, be 
embodied in many different forms and should not be 
construed as limited to the embodiments set forth herein; 
25 rather these embodiments are provided so that this 

disclosure will be thorough and complete, and will fully 
convey the scope of the invention to those skilled in the 
art. Like numbers refer to like elements throughout. 

As will be appreciated by one of skill in the art, 
30 the present invention may be embodied as a method, data 
processing system or program product. Accordingly, the 
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present invention may take the form of an entirely 
hardware embodiment, an entirely software embodiment or 
an embodiment combining software and hardware aspects. 
Furthermore, the present invention may take the form of a 
5 computer program product on a computer-readable storage 
medium having computer-readable program code means 
embodied in the medium. Any suitable computer readable 
medium may be utilized including hard disks, CD-ROMs, 
optical storage devices, or magnetic storage devices. 

10 The present invention is also described using 

flowcharts. Those skilled in the art will understand 
that each block of the flowchart illustrations, and 
combinations of blocks in the flowchart: illustrations, 
may be implemented with various commonly used 

15 communication system components. It will also be 

understood that porti ons of the operations described in 
the flowchart illustrations may be executed as computer 
program instructions loaded into a computer or other data 
processing apparatus, thus producing a machine which 

20 provides means for implementing the functions specified 
in the flowchart blocks and combinations thereof. The 
computer program may cause operational steps to be 
performed on the computer or data processing apparatus to 
produce a computer-implemented process such that the 

25 instructions which execute on the computer or data 

processing apparatus provide steps for implementing the 
functions of the flowchart blocks or combinations 
thereof. Accordingly, blocks of the flowchart 
illustrations support combinations of means for 

30 performing the specified functions and combinations of 
steps for performing the specified functions. 
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By utilizing the present invention, an existing PC 
may be used in conjunction with the set top box to supply 
many of the functions that may be desired by a user while 
watching TV. Moreover, the set top box may use the PC in 
5 conjunction with the Internet to supply the desired 

functions rather than duplicating the functionality of 
the PC within the set top box. The user may access the 
information from a specific location on the Internet 
which is associated with the desired functions. For 
10 example, the user may desire program listings, sports 
scores, weather information, access to e-mail, or 
participation in a chat room that may concern a TV 
program presently being viewed by multiple users. By 
avoiding duplication of the PC functionality within the 
15 set top box, the present invention may provide a lower 

cost alternative to users who desire the above functions 
and already have a PC. 

Figure 1A illustrates a system utilizing the present 
invention. A user may control the system with a wireless 
remote control 103. The wireless remote control 103 
wirelessly transmits user commands to the system so as to 
control the display of information on a TV. The user 
commands are transmitted to the system by pushing 
corresponding buttons on the wireless remote control 103. 
25 A set top box 100 receives the user commands and 

determines if external information is required to execute 
the user command. if external data is required, a 
computer command is wirelessly relayed to a radio 
frequency transceiver 133 radio frequency transceiver 133 
across a communications link 130. The received computer 
command is then transmitted to a PC 135. The PC 135 
determines if data is required from a network 145 or if 



20 



30 
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data may be obtained locally. If data is desired from 
the network 145, the data is returned to the PC 135 and 
the corresponding information is then wirelessly relayed, 
with any desired command, to the set top box 100 across 
5 the communications link 130 using the command protocol. 
If data may be obtained locally, the PC 135 transmits the 
corresponding information to the radio frequency 
transceiver 133 which wirelessly relays the corresponding 
information, with any desired command, across the 
10 communications link 130 to the set top box 100 using the 
command protocol. The set top box 100 then formats the 
information and command for display on the TV 115. For 
example, the returned information and command may 
describe a box that is to be drawn on the TV 115 while 
15 the data describes what the box drawn should contain. 

Referring to Figure IB, the wireless remote control 
103 is capable of controlling a range of consumer 
electronic devices. For example, the wireless remote 
control 103 may be used to control a TV, a Video Cassette 
20 Recorder (VCR) , and a cable tuner box. The wireless 
remote control 103 transmits commands over the 
communications link 110 to the wireless remote receiver 
105. In the preferred embodiment, the communications 
link 110 uses infra-red light. Although the wireless 
25 remote control 103 is described in a handheld form, other 
devices may be used as the wireless remote control 103. 
For example, a keyboard with an infra-red interface may 
be substituted for the wireless remote 103 control 
described above. 

The wireless remote control 103 includes a plurality 
of keys which may be designated as having an associated 
user command or data. When the user pushes a key,^ the 
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associated user command or data is wirelessly transmitted 
to the set top box 100 across the communications link 
110. A subset of the keys on the wireless remote control 
103 may be designated as having a user command or data 
5 associated with it that is chosen specifically for the 
purpose of practicing the present invention. For 
example, Figure IB illustrates a guide button 
corresponding to a particular command which causes the 
screen shown in Figure 1C to be displayed on the TV 115. 

10 Figure IB also shows a setup button for , a menu button 
for displaying the top level menu, a set of directional 
button for navigating through the displays, an exit 
button for exiting the menu, and three " soft keys" for 
performing functions that may vary depending on the 

15 present state of the display. For example, if the guide 
button were pressed while displaying the menu shown in 
Figure 1C, Fl may correspond to the CURRENT button, F2 
may correspond to the FAVORITES button and F3 may 
correspond to the OPTIONS button (i.e., Press Fl for 

20 CURRENT, press F2 for FAVORITES and Press F3 for 
OPTIONS) . 

The set top box 100 receives the user commands from 
the wireless remote control 103 via the communications 
link 110. The set top box 100 controls the display of 

25 information on the TV 115 in response to the user 

commands. When the user selects particular information 
for display on the TV 115, the set top box 100 formats 
the TV 115 display so that the information is displayed 
according to the user command. For example, Figure 1C 

30 illustrates an exemplary display of information in 

response to a user command corresponding to a TV program 
guide describing broadcast times for programs. Although 
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Figure 1C shows a full screen display of information, 
other modes may be used. For example, a partial display 
mode may also be used wherein the information described 
above appears on a first portion of the display while a 
5 second portion of the TV 115 is used to display other 
information (e.g., video from a TV program). 

The set top box 100 displays the information 
described above by relaying computer commands and . 
receiving corresponding information with an antenna 125 

10 according to the command protocol described herein. The 
user commands received from the wireless remote control 
103 are processed by the set top box 100 to determine 
what action is necessary to display the desired 
information. If .the set top box 100 requires information 

15 not available within set top box 100, the set top box 100 
wirelessly relays a corresponding computer command using 
the radio transceiver and an antenna 125. Commands are 
relayed using the command protocol structured as packets 
containing instructions and data concerning the 

20 information to be displayed. 

A communications link 130 is a UHF radio frequency 
signal which carries information between the set top box 
100 and a radio frequency transceiver 133. In the 
preferred embodiment, the communications link 130 

25 operates using a carrier frequency of 900Mhz. 

The radio frequency transceiver 133 receives and 
transmits information over the communication link 130 
using a radio transceiver 132 and an antenna 140. The 
operation of the radio transceiver 132 and the antenna 

30 140 is similar to those associated with the set top box 
100. The radio frequency transceiver 133 relays the 
computer commands received from the set top box 100 to 
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the PC 135. The radio frequency transceiver 133 also 
receives information from the PC 135 for relay to the set 
top box 100. The radio frequency transceiver 133 
translates information between the serial data format and 
5 the radio signal format described above. The radio 

frequency transceiver 133 may be implemented external to 
the PC 135 with a dedicated power source or internally 
within the PC 135. 

The radio frequency transceiver 133 communicates 

10 with the PC 135 through a serial data interface 131. The 
serial data interface 131 is a bi-directional 
communications device commonly found in a personal 
computer. Information received from the radio frequency 
transceiver 133 may be communicated to the PC 135 via the . 

15 serial data interface 131. Similarly, information may be 
communicated from the radio frequency transceiver 133 to 
the PC 135 via the serial data interface 131. 

The PC 135 is a computer capable of running a wide 
range of applications software and may consist of a CPU 

20 142, a memory 141, a network communications device 143, a 
hard disk drive 140, a keyboard 139, a monitor 138 and 
other hardware and software components commonly found in 
personal computers. For example, the PC 135 may be 
implemented using a Pentium microprocessor marketed by 

25 Intel running the Windows 95 Operating System marketed by 
Microsoft Inc. The PC 135 processes the computer command 
received from the set top box 100 and the corresponding 
information according to the command protocol. A 
computer program running on the PC 135 , receives 

30 information from the radio frequency transceiver 133 for 
transmission to a network 145. The computer program also 
accepts data from the network 145 for relay to the set 
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top box 100 through the radio frequency transceiver 133. 
The computer program running on the PC 135 formats the 
information to be returned to the set top box 100 in 
accordance with command protocol. 
5 The network 145 , including a collection of computers 

{i.e., a computer 150, a computer 151, and a computer 
152) , may represent the Internet. Data that is of 
particular interest to users of the system may be stored 
at particular locations on the Internet. The data on the 
10 Internet is accessed using the computer commands relayed 
by the set top box 100 to the PC 135. The information is 
then relayed to the set top box 100 for processing or 
formatting for display on the TV 115. The network 145 
described above may also be a local area network, 
15 Internet 2, or similar configuration enabling the 

distribution and storage of data. In one embodiment, the 
PC 135 may used in standalone mode wherein the PC 135 
does not access the network 145. 

Referring to Figure 2, the set top box 100 will now 
20 be described in greater detail. The set top box 100 

accepts user commands from the wireless remote control 
103, wirelessly relays computer commands corresponding to 
the user commands to the PC 135, receives information 
corresponding to the computer commands, processes and 
25 formats the corresponding information for display on the 
TV 115 in accordance with the user command. 

The set top box 100 includes a central processing 
unit (CPU) or controller 221 a Random Access Memory (RAM) 
222, a Read Only Memory (ROM) 223, a Video Processing 
30 system (VP) 218, a Video Buffer (VRAM) 219, a TV 

interface 211 including an Overlay 210, a Converter 220, 
and a Tuner/Modulator 212, a radio Frequency Transceiver 
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(RFT) 217, an antenna 125 and a wireless infra-red (IR) 
sensor 214. These individual components are well known 
to those having skill in the art and need not be 
described further herein. 
5 The CPU 221 may be suitable for running a computer 

program to process information from the PC 135, processes 
user commands from the wireless remote control 103, 
control the formatting of information for display on the 
TV 115, and provide general system services to the set 

10 top box 100. The CPU 221 may process user commands 

received from the wireless remote control 103 as a stream 
of serial data. For example, if the user pushes a button 
on the wireless remote control that corresponds to a 
command requiring information from the network 145, the 

15 CPU 221 receives the command in an internal serial buffer 
from the IR sensor 215. The CPU 221 sends a 
corresponding computer command to the RFT 217 and the 
command is transmitted over communications link 130 to 
the PC 135 and the network 145. The CPU 221 may also 

20 process information from the PC 135. For example, when 
information is returned from the network 145, it is 
received by the RFT 217. The CPU 221 accepts the 
information from the RFT 217 as a stream of serial data. 
In one embodiment, the CPU 221 may processes the data 

25 received from the wireless remote control 103 and 

information from the PC 135 and the network 145 as a 
single serial data stream. 

The CPU 221 may also control the combination of RGB 
formatted data associated with information from the PC 

30 135. RGB formatted data represents display information 
corresponding to the intensity of each color component 
for a particular pixel within an image. For example, the 
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R component corresponds to the Red intensity of the 
pixel, the G corresponds to the green intensity of the 
pixel, and the B component corresponds to the blue 
intensity of the pixel. When the three components are 
5 displayed simultaneously, the pixel exhibits a color made 
up of the three intensity components. If the user has 
issued a user command requesting that TV program listings 
be displayed on the TV 115 simultaneously with a TV 
program, the CPU 221 may transmit the appropriate RGB 
10 data to the Overlay 210 for combination with the NTSC 

signal. The CPU 221 may be implemented using a Cold Fire 
CF5306 marketed by Motorola Inc., however, analogous 
microprocessors known to those skilled in the art may 
also be used. 

15 The VP 218 may be used by the CPU 221 to control the 

combination of information from the PC 135 with a TV 
signal for display on the TV 115 or select between the 
two for display. The data from the VP 218 may be 
represented in RGB format wherein a first portion of the 

20 data represents red information, a second portion 
represents green information, and a third portion 
represents blue information. The VP 218 may be 
implemented with a YVG606 Video Processor manufactured by 
Yamaha Inc. 

25 The Overlay 210 may be used to combine RGB data from 

the VP 218 with the TV signal. The TV signal may be 
derived from an auxiliary input 275, a demodulated 
version of the external tuner input TV signal 280, 
demodulated input signal 277, provided by the 

30 Tuner/Modulator 212. The RGB formatted data may be 

combined with a TV signal formatted according to the NTSC 
standard (i.e., a signal format for display of images on 
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a TV) . The Overlay produces an RGB formatted composite 
of the RGB data from the VP 21B and the TV signal. The 
Overlay 210 may be implemented using a video mixer 
marketed by Toshiba, Inc. 
5 The Converter 220 converts the composite RGB signal 

produced by the Overlay 210 to an NTSC composite signal 
which may be displayed on a TV monitor directly. The 
Converter 230 may be implemented using a RGB to NTSC 
converter marketed by Sony, Inc. 

10 The Tuner/Modulator 212 selects an NTSC composite 

formatted signal from the Converter 220 or an external 
tuner input TV signal 280 and formats the selected signal 
as a modulated, signal for input into a TV tuner. The 
Tuner/Modulator 212 may also provide a demodulated 

15 version of the external tuner input TV signal 280 to the 
Overlay 210. The Tuner /Modulator 212 may be implemented 
using a tuner/modulator marketed by Panasonic, Inc. 

The radio Frequency Transceiver (RFT) 217 transmits 
user commands from the set top box 100 to the PC 135 

20 using a radio signal. The RFT 217 also receives 

information from the PC 135 for processing and formatting 
by the set top box 100 using a radio signal. The RFT 217 
is FCC part 15 compliant and may be implemented with two 
RFM 9901s and an RFM 9902 manufactured by Radio Frequency 

25 MicroDevices Inc. 

The wireless IR sensor 214 receives user commands 
from the wireless remote control 103 over communications 
link 110. The wireless IR sensor 214 provides the 
relayed user commands from the wireless remote control 

30 103 to the CPU 221 for processing. The user commands are 
processed by the CPU 221 as a serial data stream. 
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Referring to Figure 3, overall operations of a 
system utilizing the present invention will now be 
described. The operation of the system begins when the 
user presses a button on the wireless remote control 103 
5 (Block 300) . As described above, the button pushed 
corresponds to a user command which carries out a 
function desired by the user. The user command is 
transmitted across the communications link 110 to the 
wireless remote control receiver 120 (Block 305) . The 

10 relayed command is placed in a serial input buffer for 
service and an interrupt is generated to the CPU 221. 
The CPU determines the nature of the user command and 
relays a corresponding computer command to the radio 
frequency receiver 217 f across the communication link 130 

15 to the radio frequency transceiver 133 (Block 310) . 

The radio frequency transceiver 133 transfers the 
relayed computer command to the PC 135 via the Serial 
Interface Unit 131. If the PC 135 is connected to the 
Internet (Block 311) , the PC 135 accesses the Internet 

20 (Block 315) and receives the data required by the 

computer command (Block 320) . If the PC 135 is not 
connected to the Internet (Block 311) , the required data 
may be retrieved locally (Block 313) . For example, 
information may be provided via a CD-ROM and accessed 

25 locally by the PC. Alternatively, an Internet connection 
may be established. 

The received data is then formatted in accordance 
with the command protocol (Block 325) and the PC 135 
relays the information corresponding to the received data 

30 across the communication link 130 to the set top box 100 
(Block 330) . The set top box processes and formats the 
received information for display on the TV 115 connected 
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to the set top box 100 (Block 335) , completing the 
process (Block 340) . 

Referring to Figures 4A, 4B, 4C, 4D, and 4E a 
command protocol and the packet format used to transfer 
5 data between the set top box 100 and the PC 135 will now 
be described in greater detail. Information relayed 
between the set top box 100 and the PC 135 may be 
structured according to the packet format illustrated in 
Figure 4B. The packet format includes a START byte, an 
10 ' ID word, an INSTR byte, a LENGTH word, a number of DATA 
bytes, a CKSUM word, and a STOP byte. The Start byte 

■A 

signals the start of the packet. In a particular 
embodiment, the START byte .is the hexadecimal value OxFF. 
The ID word is. the least significant word of the set. top 

15 box's serial number. The INSTR byte is the instruction 
or command to be executed by the set top box 100. The 
LENGTH word is the number of bytes contained in the DATA 
field. The DATA is a number of data bytes associated 
with the INSTR field. For example, if a particular 

20 command or instruction has associated data or parameters, 
the data is stored in the DATA field. The number of data 
bytes included in the DATA field is described by the 
LENGTH field. The CKSUM is the least significant word of 
the sum of each byte contained in the INSTR, LENGTH, and 

25 DATA fields. The STOP byte signals the end of the 

packet. In a particular embodiment, the STOP byte is the 
hexadecimal value OxFF. 

As shown in Figure 4A, the command protocol may be 
separated into three blocks or modules (Block 401, Block 

30 402, and Block 403) . The process begins in Block 410 
when incoming data is received. The received data is 
identified (Block 420) as user command data from the 
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wireless remote control 103 or information from the PC 
135 (Block 440), user command data is processed and 
transmitted to the PC 135 (Block 450) . Information from 
the PC 135 is processed in Block 402. Block 401 also 
5 executes commands from the PC 135 after processing (Block 
402) and verification (403) . 

When a serial input interrupt occurs, an interrupt 
vector routine stores the incoming command in a receive 
buffer for later processing (Block 420) . Incoming 
10 information from the PC 135 is also stored in a receive 
buffer (Block 420) . There may be one receive buffer for 
each serial input (i.e., the RFT 217 and wireless IR 
sensor 214) . 

As the receive buffer is processed, a flag is set if 

15 a valid packet is received (Block 420) . The data may be 
a user command from the wireless IR sensor 214 input 
(i.e., the keyboard or wireless remote control 103), or 
information from the RFT 217 input from the PC 135. If 
an IR input is valid (Block 440), it is queued up, 

20 packetized, and transmitted to the PC 135 (Block 450) . A 
flag is set to wait for that packet to be received. If a 
time-out or FAIL occurs, the packet is resent. If an 
OKAY instruction is returned from the PC 135, the 
transmitted user command was received by the PC 135 and 

25 the flag is cleared (Block 450) . Figure 4C illustrates a 
particular embodiment of processing the user command data 
and execution of information from the PC 135. 

If information is received from the PC 135 (Block 
440) , the receive packet routine is called (Block 402) 

30 wherein the information is shifted into a packet. A flag 
is set if a packet header matches. While the flag is 
set, the information is stored in the various sections 
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for a number of bytes . Next, the CKSUM and STOP fields 
are read. The flag may be reset by either an error or 
time-out. Figure 4D illustrates a particular embodiment 
of formatting and processing described above. 
5 The formatted and processed information is then 

verified (Block 403) . The checksum is calculated and 
compared. The STOP byte is also compared. Flags are set 
to show status. If an execution flag is set, the 
instruction is executed later (Block 430) . When the 

10 instruction is executed, an OKAY packet is sent back. A 
FAIL packet is sent if the header matched, but the rest 
of the packet was bad. Figure 4E illustrates a 
particular embodiment of the verification process 
described above. 

15 Figure 5 is a list of instructions and commands that 

may be used in a system utilizing the present invention. 
The instructions and commands shown in Figure 5 may be 
transmitted as information from the PC 135 to the set top 
box 100 so as to carry out the user commands desired by 

2 0 the user. The instructions and commands shown in Figure 

5 may be grouped according to the function each 
instruction or command provides when transmitted to the 
set top box. The drawing packets control what elements 
are drawn on the TV display. The control packets 

25 determine how the elements included in the drawing 

packets will be displayed. The status packets signal the 
status on the drawing and control packets sent from the 
set top box. 

A particular example will now be discussed in 

30 greater detail. When the user pushes the menu button on 
the wireless remote control 103, the menu shown in Figure 

6 is displayed on the TV 115. The display is 
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accomplished by a series of instructions relayed to the 
set top box 100 that correspond to the menu button. 
Specifically, the PC 135 relays a SHOWJT RAN S PARENT 
instruction followed by a BG_COLOR instruction, followed 
5 by a CLEAR_SCREEN instruction. These instructions are 

used to control the drawing of information on the TV 115. 
A second series of instructions (i.e., drawing packets) 
is then relayed to the .set top box 100. Specifically, a 
DRAW_3DBOX instruction is transmitted followed by a 

10 PAINT__BOX instruction. These instructions draw on the TV 
115. Finally, a third set of instructions is relayed to 
the set top box 100. Specifically, a GO_TO_XY 
instruction is sent followed by a SET__FG_COLOR 
instruction followed by a PRINTF instruction. This 

15 series of instructions controls the information displayed 
in the boxes drawn on the TV 115. 

Figures 6 through 32 illustrate a set of exemplary 
commands and displays that may appear in a system 
utilizing the present invention. As described above, the 

20 system may include selecting a service, displaying and 
using a program guide and its various options, using an 
Email service to check/send Email, using a news service 
to browse the latest news, using a sports service to know 
the latest sports news, using a weather service to see 

25 the current weather and the forecast, and using a Chat 
service to communicate with other people over the 
network. 

Selecting a service 

30 1. When the MENU button on the remote/keyboard is 

pressed, the screen shown in Figure 6 may be displayed: 
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2. The arrow buttons may then be used to highlight a 
choice and press ENTER. 

Guide 

5 Displaying the program Guide 

1. Highlight GUIDE from the System's main menu and 
press ENTER or Press GUIDE button on the remote. 

2. The Program Guide Screen is displayed as shown 
in Figure 7 . 

10 3. The first program in the first row of Figure 7 

is highlighted initially on the Program Guide Screen. For 
example, "High Incident" will be highlighted initially in 
the above screen. 



15 Moving through the Program Guide 

1. The arrow buttons may be used to scroll through the 
Program Guide (i.e., press right arrow button to move 
right, left arrow button to move left, up arrow button 
to move up and down arrow button to move down) . 

20 2. As the Guide scrolls, the appropriate event is 

highlighted to show the current location on guide. 
3. If the Guide scrolls out of the current time-span, 
pressing the CURRENT button will return the Guide to 
the present time. For example, in Figure 7 if the Guide 

25 scrolls to the right to 12 AM, the Guide may return to 

8 PM by pressing the CURRENT button. 

Getting More Information on an Event : 
1. To see more details on any event, scroll to that 
30 event and press Enter. For example, if "The Net" is . 

selected and Enter is pressed, the display in Figure 8 is 
shown. 
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2. Pressing REMIND ME will add/remove the selected 
event to the reminders list. 

Note: See the section "Using the REMIND ME option" 
for more information 
5 3. Pressing PREVIOUS will return the Guide the 

Program Guide Screen, 

4. Pressing OTHER TIMES will display the additional 
times this program is ON. For example, if OTHER TIMES is 
pressed in Figure 8, the following is displayed. 
10 5. Pressing REMIND ME will add/remove the selected 

event to/from the reminders list. 

Note: See the section "Using the REMIND ME option" 
for more information . 

6. Pressing PREVIOUS will return the Guide to the 
15 previous screen. 

7. Pressing CLOSE will return the Guide the Program 
Guide Screen. 

Using the REMIND ME Option 
20 The REMIND ME feature may be used to remind the user 

of the programs selected, just before their starting 
times. To do this, First add the programs desired to a 
reminders list. For every event in the reminders list, 
the System displays a message on the TV screen 5 minutes 
25 before its starting time. If the System is used to change 
channels, it will automatically change channels one 
minute before the starting time of the events in the 
reminders list. 

To use the REMIND ME feature from the Program Guide 
30 Screen do the following: 

1. Press the GUIDE button on the remote. The 
Program Guide Screen is displayed as shown in Figure 7. 
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2. Highlight the desired program by scrolling to it 
using arrow buttons. 

3. Press the OPTIONS button. The OPTIONS menu screen 
is displayed as shown in Figure 10. 

5 4. Select the REMIND ME Option and Press ENTER. 

Nate: If the event is already in the reminders 
list, it is deleted from the list. 

1. Follow Steps 1 & 2 given above to select an event 
on the Program Guide Screen. 
10 2. When the desired event is highlighted press 

Enter. A screen showing additional information on the 
program is displayed. For example, if "The Net" is 
selected from the Program Guide Screen shown in Figure 7 , 
the screen. shown in Figure 8 is displayed. 
15 3. Pressing the REMIND ME button on this screen 

will add the event to the reminders list. 
Note: 

1. If the event is already in the reminders list, it is 
deleted from the list. 

20 2. Events may also be added to the reminders list by 

pressing the REMIND ME button on any screen that pops 
up with a REMIND ME option while using the System. 

View Listings of Favorite Program Type 
25 1. Press the OPTIONS button on the Program Guide Screen. 
The "Options Menu" screen is displayed as shown in 
Figure 10. 

2. Scroll to the SELECT PROGRAM TYPE option using arrow 
buttons and press ENTER. The screen shown in Figure 11 

30 is displayed. 

3. Select a program type and press ENTER. If 
movies/sports is selected, another screen is displayed 
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allowing a category of movie/sport to be selected. For 
example, if sports is selected, the screen shown in 
Figure 12 is displayed. 

4. Choose a category and press ENTER. The appropriate 

5 events are displayed in the ascending order of date & 

time. For example, if you select "Football" the screen 
in Figure 13 is displayed. 

5. Selecting REMIND ME on this screen, adds the event 
currently highlighted to the reminders list and ensures 

10 prompting at the starting time of this event. If the 

event is already in the list, it is deleted from the 
list. 

Searching the listings : 
15 It is possible to use the search option of the 

System to search the listings for a program. To use the 
SEARCH feature do the following: 

1. Press the GUIDE button on the remote. The Program 
Guide Screen shown in Figure 7 is displayed. 
20 2. Press the OPTIONS button on the Program Guide Screen. 
The "Options Menu" screen shown is Figure 10 is 
displayed. 

3. Scroll to the SEARCH option using the arrow buttons and 
press ENTER. The search screen is displayed as shown in 

25 Figure 14. 

4. Enter a search string and press OK to see the events 
containing the search string. For example, if the word 
"Net" is entered in the search box, all the programs 
with the word "Net" in their title are displayed as 

30 shown in Figure 15. 

5. It is possible to search the listings for movies by 
entering the actor's name. If only a part of an 
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actor's name is given, then all the movies of the 
actors with that part in their name are reported. For 
example, if searching for "Torn", all movies of "Tom 
Hanks", "Tom Cruise", etc. would be returned. 

5 

Choosing Favorite Channels 

1. Press the GUIDE button on the remote. The Program 
Guide Screen is displayed as shown in Figure 7. 

2. Press the OPTIONS button on the Program Guide Screen. 
10 The "Options Menu" screen is displayed as shown in 

Figure 10. 

3. Scroll to the CHOOSE FAVORITE CHANNELS option using 
arrow buttons and press ENTER. The screen, consisting 
of the channel names,, is displayed as shown in Figure 

15 16. 

4. Use arrow buttons to highlight a particular channel. 
Mote : To view more channels , move up/down using arrow 
buttons . 

5. Press ENTER to add/remove the selected channel to/from 
20 the favorite channels list. If the channel is already 

in the favorites list, it is removed from it when ENTER 
is pressed (the check mark next to it will disappear) . 
Otherwise, it will be added to the list (the check mark 
will appear next to it) . 
25 6. Press OK to accept the changes (or) CANCEL to ignore 
them. 



View the program guide with only the favorite channels 

1. Press the GUIDE button. The Program Guide Screen is 
30 displayed as shown in Figure 7. 

2. Press the FAVORITES button on the Program Guide Screen. 
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3. The program guide is displayed with listings for only 
the users favorite channels. 

Mail 

5 The Mail feature lets the user send/receive e-mail 

messages . 
Checking Email : 

1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 
10 2. Select MAIL from the main menu screen and press ENTER. 
The screen shown in Figure 17 is displayed. 

3. Select CHECK MAIL and press ENTER. 

4. The "Mail Inbox" is displayed: with copies of the new e- 
mail messages and displayed as shown in Figure 18. 

15 5. To view a message, use the arrow buttons to select it 
and press ENTER. The message is displayed as shown in 
Figure 1 9 . 

6. To Reply to (or) Forward an e-mail, go to the "Mail 
Inbox", select the message and press. the appropriate 
20 button. 

Sending an Email: 

1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 
25 2. Select MAIL from the main menu screen. The following 
screen is displayed as shown in Figure 17. 

3. Select SEND MAIL option and press ENTER. 

4. The screen shown in Figure 20 is displayed allowing the 
user to compose an e-mail message. 

30 5. Use "tab key" to move between the fields. 
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6. After typing the message, press the SEND button to send 
it. 

7. Press CANCEL to cancel sending the e-mail. 

5 Setup Options : 

1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 

2. Select MAIL from the main menu screen and press ENTER. 
The screen shown in Figure 17 is displayed. 

10 3. Select SETUP OPTIONS and press ENTER. The following 
screen shown in Figure 21 is displayed. 
4. Enter the appropriate information. If the user has a 
direct connection, the Dial-Up Information may not be 
necessary. 
15 5. Press OK to accept the changes. 

6. Press CANCEL to ignore the changes. 



News 

Reading News : 

20 1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 

2. Select NEWS from the main menu screen and press ENTER. 
The screen shown in Figure 22 is displayed 

3. To view a news item, scroll to it using arrow buttons 
25 and press ENTER. 

4. To e-mail a news item, select the news item and press 
the MAIL button. 



Setting News Options :. 
30 The News feature consists of different news 

categories. The user may customize the news service by 
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going into the news options and selecting/deselecting 
various categories. The follow instructions set the news 
options: 

1. Press the MENU button on the remote/keyboard* The main 
5 menu screen is displayed as shown in Figure 6. 

2. Select NEWS and press ENTER. The screen shown in Figure 
22 is displayed. 

3. Press the SETUP OPTIONS Button. The screen shown in 
Figure 23 is displayed : 

10 4 . Use arrow buttons to scroll to a category and highlight 
it. 

5. Press ENTER to Select/Deselect it. If the category is 
already, selected, it is deselected when pressing ENTER 
(the check mark next to it will disappear) . Otherwise, 

15 it will be selected (the check mark will appear next to 

it) . 

6. Press OK to accept the changes (or) CANCEL to ignore 
them. 

20 Sports 

Reading Sports : 

1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 

2. Select SPORTS from the main menu screen and press 
25 ENTER. The screen shown in Figure 24 is displayed 

3. To view a sports item, scroll to it using arrow buttons 
and press ENTER. 

4. To e-mail a sports item, select it and press the MAIL 
button. 



30 
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Setting Sports Options : 

The Sports feature provides news on various sports. 
The user may customize the sports news service by going 
into the sports options and selecting/deselecting various 
5 sports. Follow the instructions below to set the news 
options : 

1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 

2. Select SPORTS from the main menu screen and press 
10 ENTER. The screen shown in Figure 24 is displayed. 

3. Press the SETUP OPTIONS button. The screen shown in 
Figure 25 is displayed. 

4 . Use arrow buttons to scroll to a sports category and 
highlight it. 

15 Note : To view more sports, scroll up/down using arrow- 
buttons . 

5. Press ENTER to Select /Deselect it. If the category is 
already selected, it is deselected when pressing ENTER 
(the check mark next to it will disappear) . Otherwise, 

20 it will be selected (the check mark will appear next to 

it) . 

6. Press OK to accept the changes (or) CANCEL to ignore 
them. 



25 Weather 

Setting Weather Options : 

1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 

2. Select WEATHER from the main menu screen and press 
30 ENTER. The screen shown in Figure 26 is displayed. 
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3. Select SETUP OPTIONS and press ENTER. The screen 
showing a list of various cities is displayed as shown 
in Figure 27. 

4. Use arrow buttons to scroll to a city and highlight it. 
5 Note : To view more cities, scroll up/down using arrow 

buttons . 

5. Press ENTER to Select/Deselect a city. If the city is 
already - selected, it is deselected when pressing ENTER 
(the check mark next to it will disappear) . Otherwise, 

10 it will be selected (the check mark will appear next to 

it) . 

6. Press OK to accept the changes (or) CANCEL to ignore 
them. 

15 Checking Current Weather : 

1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 

2. Select WEATHER from the main menu screen and press 
ENTER. The screen shown in Figure 26 is displayed. 

20 3. Select CURRENT WEATHER and press ENTER. The current 
weather is displayed for the city chosen as shown in 
Figure 2 8 . 

4. To view more cities, scroll up/down using arrow 
buttons . 

25 5. Press SHOW MAP to see a U.S. weather map. 

6. Press FORECAST to see the weather forecast of the city 
currently highlighted . 



Checking the Forecast: 
30 1. Press the MENU button on the remote/keyboard. The main 
menu screen is displayed as shown in Figure 6. 
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2. Select WEATHER from the main menu screen and press 
ENTER . The screen shown in Figure 26 is displayed. 

3. Select FORECAST and press ENTER. The weather forecast 
is displayed for the first city chosen as shown in 

5 Figure 29. 

4. Press NEXT CITY to see the forecast for the next city 
in the selected cities list. 

Chat 

10 The chat feature allows the user to communicate with 

different people over the Internet while watching TV. 

1. Press the MENU button on the remote/ keyboard. The main 
menu screen is displayed as shown in Figure 6. 

2. Select CHAT on the main menu screen and press ENTER. 
15 The screen shown in Figure 30 is displayed. 

3. Enter the user's nickname and press OK. If the 
nickname chosen is already being used by another user, 
the user will be prompted to choose another nickname 

4. If the nickname is valid, the user will see a list of 
20 channels each consisting of various chat rooms 

displayed as shown in Figure 31. 

5. Use arrow buttons to select a channel. The chat rooms 
related to that channel will appear on the right 
section. 

25 6. Use tab key to shift between channel names and chat 
rooms . 

7. Scroll to a favorite chat room using arrow buttons and 
click on JOIN. The user will see the ongoing discussion 
on your screen. The user may type a message in the box 

30 below the discussion area as shown in Figure 32. 

8. To exit, press EXIT button. 
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In the drawings and specification, there have been 
disclosed typical preferred embodiments of the invention 
and, although specific terms are employed, they are used 
in a generic and descriptive sense only and not for 
5 purposes of limitation, the scope of the invention being 
set forth in the following claims. 
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That Which is Claimed: 

1. A set top box that interfaces a television and 
a personal computer that is connected to the Internet, 
the set top box comprising: 

a wireless remote control receiver that receives 
5 user commands from a wireless remote control unit; 

a radio frequency transceiver that transmits 
computer commands to the personal computer that is 
connected to the Internet in response to the user 
commands and that receives data that is generated from 
10 the internet via the personal computer in response to the 
computer, commands; 

a video processing system that processes the 
received data for display on a television; and 

a television interface that displays the processed 
15 received data on the television. 



2. 'A set top box according to Claim 1 wherein the 
television interface simultaneously displays the 
processed received data and a television program on the 
television. 



3. A set top box according to Claim 2 wherein the 
television interface overlays the processed received data 
on a television program. 

4. A set top box according to Claim 1 wherein the 
wireless remote control receiver is an infrared remote 
control receiver. 
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5. A set top box according to Claim 1 in 
combination with a personal computer that is connected to 
the Internet, the personal computer including a second 
radio frequency transceiver that receives the computer 

5 commands from the radio frequency transceiver and that 

transmits the data that is generated from the Internet to 
the radio frequency transceiver. 

6. A set top box according to Claim 1 in 
combination with a television that is connected to the 
television interface . 

7. A set top box according to Claim 1 in 
combination with a wireless remote control unit that 
wirelessly relays user commands to a television and to 
the set top box. 

8. A set top box according to Claim 7 wherein the 
wireless remote control unit is a wireless computer 
keyboard . 

9. A television set top box comprising: 
an infrared receiver; 
a radio frequency transceiver; 
a controller that processes signals from the 

infrared receiver and the radio frequency transmitter; 

a video buffer, responsive to the controller to 
generate RGB video data; 

an RGB overlay unit that combines the RGB video data 
and a television signal to produce a combined RGB signal; 

an converter that converts the combined RGB signal 
into a combined television signal; and 



5 
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a television modulator that modulates the combined 
television signal for display on a television. 

10. A set top box according to Claim 9 wherein the 
RGB overlay unit combines the RGB video data and the 
television signal to produce a combined RGB signal that 
displays the RGB video data on a first portion of a 

5 television and that displays the television signal on a 
second portion of the television. 

11. A set top box according to Claim 10 wherein the 
television signal is an NTSC television signal. 

12.. A method for interfacing a television to the 
Internet comprising the steps of: 

wirelessly receiving user ' commands at a set top box; 

wirelessly relaying computer commands that represent 
5 the user commands from the set top box to a personal 
computer in response to the wirelessly received user 
commands ; 

causing the personal computer to access the Internet 
in response to the computer commands; 
10 receiving data from the Internet at the personal 

computer; 

wirelessly relaying information representing the 
received data from the personal computer to the set top 
box; and 

15 formatting the information for display on a 

television that is connected to the set top box. 



13. A method according to Claim 12: 
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wherein the step of causing the computer to access 
the Internet comprises the step of causing the personal 
computer to access a location which is associated with 
5 the set top box; and 

wherein the step of receiving data from the Internet 
comprises the step of receiving data from the location 
that is associated with the set top box. 

14. A method according to Claim 13 wherein the 
receiving step comprises the step of receiving television 
program guide data from the location which is associated 
with the set top box. 

15. .A method according to Claim 13 wherein the 
receiving step comprises the step of receiving sports 
scores from the location that, is associated with the set 
top box. 

16. A method according to Claim 13 wherein the 
receiving step comprises the step of receiving data that 
is formatted for display on a television rather than a 
computer monitor, from the location which is associated 

5 with the set top box. 

17. A method according to Claim 12 wherein the step 
of wirelessly relaying information representing the 
received data from the personal computer to the set top 
box comprises the step of wirelessly relaying drawing 

5 commands from the personal computer to the set top box. 

18. A method according to Claim 17 wherein the 
formatting step comprises the step of converting the 
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drawing commands into a video signal for display on a 
television . 

19. A method according to Claim 12, wherein said 
step of wirelessly relaying information representing the 
received data from the personal computer to the set top 
box comprises the steps of: 

5 wirelessly relaying a control packet from the 

personal computer to the set top box so as to format the 
display of a drawing packet; 

wirelessly relaying a drawing packet from the 
personal computer to the set top box so as to draw on the 
10 TV display; and 

wirelessly relaying a status packet from the set top 
box to the personal computer so as to report on the 
status of the drawing packet. 

20. A method according to Claim 18 wherein the 
converting step is followed by the step of combining the 
video signal with a television program signal to produce 
a combined video signal for display on a television. 

21. A system that interfaces a television and a 
personal computer that is connected to the Internet, the 
system comprising: 

a wireless remote control unit that wirelessly 
transmits user commands; 

a set top box comprising: 

a wireless remote control receiver that receives the 
user commands from the wireless remote control unit; 

a first radio frequency transceiver that transmits 
computer commands to the personal computer that is 



5 



10 
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connected to the internet in response to the user 
commands and that receives data that is generated from 
the internet via the personal computer in response to the 
computer commands; 

15 a video processing system that processes the 

received data for display on a television; and 

a television interface that displays the processed 
received data on the television; 

a second radio frequency transceiver for connection 

20 to the personal computer to receive the computer commands 
from the first radio frequency transceiver and to 
transmit the data that is generated from the internet ; 
and 

a computer program for execution in the personal 
25 computer, the computer program comprising computer 

readable instructions that direct the computer to obtain 
the data from the Internet in response to the computer 
commands . 

22. The system according to Claim 21, wherein the 
television interface simultaneously displays the 
processed received data and a television program on the 
television. 

23. The system according to Claim 21, wherein the 
television interface overlays the processed received data 
on a television program. 

24. The system according to Claim 21 wherein the 
wireless remote control receiver is an infrared remote 
control receiver. 
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25. The system according to Claim 21 wherein the 
set top box in combination with a personal computer that 
is connected to the Internet, the personal computer 
including a second radio frequency transceiver that 
5 receives the computer commands from the radio frequency 
transceiver and that transmits the data that is generated 
from the Internet to the radio frequency transceiver. 
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Figure 4A 
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Packet format 



START 


ID 


INSTR 


LENGTH 


[DATA] 


CKSUM 


STOP 


BYTE 


WORD 


BYTE 


WORD 


n BYTES 


WORD 


BYTE 



CKSUM = the least significant word of the sum of each BYTE contained in: INSTR, LENGTH, DATA 
START = the start BYTE, usually OxFF 
STOP = the stop BYTE, usually OxFF 

ID = the least significant WORD of the TV BOX serial number 
INSTR a the instruction or command to be executed 
LENGTH = the length in BYTES of the following data stream 
DATA = any data that may be required for the instruction 
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Figure 4C 



WO 99/35831 



9 / 38 



PCT/US99/00461 




Figure 4D 
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